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NOTES ABOUT THE SURVEY 

This report covers surveys that were administered to teachers 
and principals in the San Francisco Unified School District 
over the course of three consecutive academic years from 2009 
to 2012. 

This report appears in two parts, each highlighting some of the 
aggregated responses from the teachers, and from the 
principals, respectively. 

For teachers, the sample size is: 1103 (2011-12), 1121 (2010- 

11) , and 1649 (2009-10). Meanwhile, for principals: 50 (2011- 

12) , 65 (2010-11), and 88 (2009-10). 

For teachers, the survey response rate is: 35% (2011-12), 33% 
(2010-11) and 53% (2009-10). For principals: 43% (2011-12), 
54% (2010-11) and 82% (2009-10). 


ABOUT CEPA 

Stanford's Center for Education Policy Analysis (CEPA), an 
independent research center, unites an interdisciplinary array 
of nationally prominent scholars from across the campus to 
provide the depth and scale of research needed to affect 
education policy in meaningful ways. The core researchers are 
drawn from the fields of economics, law, political science, 
psychology, public policy, and sociology, and currently reside 
in the schools of Arts and Humanities, Business, Education 
and Law, as well as at the Hoover Institution. Their rigorous 
inquiry is based on the empirical realities of schools, well 
grounded in the needs of policy makers and education 
practitioners, and aimed directly at improving education for all 
students. 

LEGEND 

< > Indicates a reference to the actual survey question 
number, linked to the appendix 

»> Indicates the context or framing of subsequent 
sub-question 

An indent indicates this is a sub-question 

► Indicates a bullet point, highlighting main points from 
the results 
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ABOUT THIS REPORT 
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This survey report was prepared by Niu Gao, a Data Ana¬ 
lyst with the Center for Education Policy Analysis (CEPA) 
at Stanford University. 

Questions or comments, please contact CEPA at: 
contactcepa@stanford.edu 





A. SUMMARY OF TEACHERS’ SURVEY RESPONSES 

SECTION I. Key Patterns & Trends 


Report I. 


=^> Majorities of teachers (>80%) were observed teaching at least once by the person who ultimately assigned 
them their evaluation ratings during 2011-12 school year and the pattern was similar in previous school 
year (Q12). 

=> The average length of observation was between 31 to 60 minutes (Q13). 

=^> Overall, teachers had positive attitudes towards the evaluation system both in their current schools and in 
SFUSD. For instance, in 2011-12, 65 percent of teachers were satisfied with the evaluation system in their 
current schools. With regard to the evaluation system in SFUSD, 72 percent of teachers were confident in 
the evaluator’s ability to observe and describe their instructional practices and 78 percent of teachers 
believed that they were evaluated fairly. Interestingly though, majorities of teachers viewed the evaluation 
as a way to dismiss tenured teachers for poor instructional performance (Q14, Q15). 

=> Teachers’ attitudes toward PAR changed over the years. In 2009-10, majorities of teachers (64%) would 
not volunteer to participate in PAR. In 2011-12, the number decreased to 46%. At the same time, the share 
of teachers who were uncertain (i.e, reported “do not know”) increased from 27% to 43%. The share of 
teachers who would participate in PAR stays roughly the same across years (11%) and only a quarter of 
teachers would refer their peers to PAR through UBC representative (Q18, Q19). 
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SECTION II. SELECT SURVEY RESULTS 


How many times were you observed teaching (for the purpose of evaluation) by the person who ultimately 
assigned you your most recent evaluation rating? <Q212> 



■ 2011-12 
■ 2010-11 


Source: Stanford survey of teachers, 2011-12, 2010-11. 

Number of valid responses: 642 (2011-12); 658 (2010-11). 

Survey item not included in 2009-10 survey. 

► Majorities of teachers (>80%) were observed teaching at least once by the person who ultimately assigned them their 
evaluation ratings during 2011-12 school year and the pattern was similar in previous school year. 


What was the average length of each observation? <qi.3> 


40% 



> 15 15-30 31-45 46-60 61+ not 

minutes minutes minutes minutes minutes applicable 


► The average length 
of observation was 
between 31 to 60 
minutes. 


H2011-12 

■2010-11 
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Source: Stanford Survey of teachers, 2011-12, 2010-11. 
Number of valid responses: 642 (2011-12); 658 (2010-11). 
Survey item not included in 2009-10 survey. 




















Report I. 


How much do you agree with each statement regarding the evaluation system in SFUSD? <Q14> 

AGREE DISAGREE 

% % 


1 was confident in evaluator’s ability to observe and describe my instructions 

72 

28 


(68) 

(31) 

1 was evaluated rigorously 

68 

32 


(64) 

(34) 

1 was evaluated fairly 

78 

21 


(77) 

(22) 

The evaluation process helped me improve my teaching practice 

57 

42 


(53) 

(45) 

My evaluator provided me with information and strategies to improve instruction 

62 

37 


(59) 

(39) 

The evaluation process was worth the time and effort required to complete it 

61 

39 


(59) 

(40) 

The evaluation process was executed properly 

75 

24 


(76) 

(23) 

The evaluation process is an important part of developing high quality teaching 

73 

26 


(70) 

(29) 

1 was well informed of he expectations and standards required for the evaluation 

82 

17 

(82) 

(17) 


68 

30 

Dismissing tenured teachers for poor instructional performance 

(73) 

(26) 


Responses from 2010-11 survey in parenthesis. 

Source: Stanford Survey of teachers, 2011-12, 2010-11. 

Number of valid responses: 629 (2011-12); 646 (2010-11). 

This survey item was not included in the 2009-10 survey. 

► 72 percent of teachers were confident in the evaluator’s ability to observe and describe their instructional practices 
and 78 percent of teachers believed that they were evaluated fairly. Interestingly though, majorities of teachers viewed 
the evaluation as a way to dismiss tenured teachers for poor instructional performance. 
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Overall, how satisfied are you with the evaluation system in your current school? <Q15> 


2010-11 



2011-12 




65 % 

35 % 


I_I_I_I_I 

0% 20% 40% 60% 80% 100% 


Source: Stanford Survey of teachers, 2011-12, 2010-11. 
Number of valid responses: 626 (2011-12); 635 (2010-11). 
Numbers do not add up to 100% due to missing entries. 

This survey item was not included in the 2009-10 survey. 


B Satisfied 
w Dissatisfied 


► Overall, teachers had positive attitudes towards the evaluation system both in their current schools and in SFUSD. 
For instance, in 2011-12, 65 percent of teachers were satisfied with the evaluation system in their current schools. 

















Report I. 


Would you volunteer to participate in PAR. <Q18> 



H No 
■ Yes 

H Don't Know 


Source: Stanford Survey of teachers, 2011-12, 2010-11, 2009-10. 

Number of valid responses: 612 (2011-12); 630 (2010-11), 834 (2009-10). 

► Teachers’ attitudes toward PAR changed over the years. In 2009-10, majorities of teachers (64%) would not 
volunteer to participate in PAR. In 2011-12, the number decreased to 46%. At the same time, the share of teachers 
who are uncertain (i.e, reported “do not know”) increased from 27% to 43%. The share of teachers who would 
participate in PAR stays roughly the same across years (11%). 


Would you refer to PAR through the Union Building Committee representative? <Q19> 



hNo 

■ Yes 

■ Don't Know 


► Each year, 
one quarter of 
teachers would 
refer their peers 
to PAR through 
the UBC 
representative. 


Source: Stanford Survey of teachers, 2011-12, 20/0-11, 2009-10. 

Number of valid responses: 611 (2011-12); 632 (2010-11), 854 (2009-10). 
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SFUSD Teacher Evaluation 


B. SUMMARY OF PRINCIPALS’ SURVEY RESPONSES 

SECTION I. Key Patterns & Trends 


=> In 2009-2012, principals relied mostly on unscheduled classroom walk-throughs to find out about teachers’ 
instructional practices. Interestingly, in 2010-11, about one-third of principals also reported the extensive 
use of formal evaluation process in determining teachers’ instructional practices (Q15). 

=> Majorities of principals believed that the new teacher evaluation template improved their abilities to 
evaluate teachers and make decisions based on evaluation ratings (Q19). 

=> In 2011-12, majorities of principals held CSTP standards based evaluation meetings (89%), held CSTP 
based pre-observation conversations (84%), reviewed written lesson plans (60%), shared their observation 
scripts (64%), and held CSTP-based post-observations (62%) with all teachers. The numbers represent an 
increase from the previous year (Q20). 

=> In 2011-12, most principals shared thinking on rubric with their peers (56%), discussed teacher evaluation 
and best practices at Area meetings (60%), and met all contractual deadlines for observations and 
conferences (73%). However, majorities of them did not ask their peers for input (51%), did not share 
observation data with peers (62%), did not help others in determining ratings using the rubrics and 
performance indicators (56%), and did not help others to determine commendations and recommendations 
on evaluation (64%). The pattern in previous school year was similar (Q21). 

=> Majorities of principals were interested in moving to the revised 2009 CSPT, however, they prefer to use 
only 5-8 elements per observation cycle. They were also interested in participating in peer feedback on 
their observation scripts, evaluation ratings and narratives. Also, half principals think they need more 
training at using the rubric and performance indicators and at holding hard conversations (Q22). 




SECTION II. SELECT SURVEY RESULTS 

What do you rely on the most to find out about teachers’ instructional practices? <Q15> 


Report I. 


Unscheduled classroom walk-throughs 


Targeted observations of specific teach 


Discussions w/ teacher 


Monitoring student performance data 


Reviewing student work 


Reports from other school leaders 


Reports from other teachers 


Formal evaluation process 



0% 10% 20% 30% 40% 50% 60% 


■ 2011-12 
■ 2010-11 
H 2009-10 


70% 


Source: Stanford Survey of principals, 2011-12, 2010-11, 2009-10. 

Number of valid responses: 47 (2011-12); 58 (2010-11), 87 (2009-10). 

► In 2009-2012, principals relied mostly on unscheduled classroom walk-throughs to find out about teachers’ 
instructional practices. Interestingly, in 2010-11, about one-third of principals also reported the extensive use of formal 
evaluation process in determining teachers’ instructional practices. 
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To what extent has the new teacher evaluation improved your ability to do each of the following? <Q19> 



Not at 

All 

% 

A Little 

% 

Some 

% 

Quite a 

Bit 

% 

A Lot 

% 

To do objective evaluation 

13 

18 

31 

31 

7 


(17) 

(19) 

(24) 

(26) 

(15) 

To evaluate using CSTP 

7 

2 

18 

47 

27 


(II) 

(15) 

(15) 

(31) 

(28) 

To have conversations about instructional best practices 

9 

7 

33 

38 

13 


(13) 

(13) 

(35) 

(22) 

(15) 

To use rubrics to determine the ratings 

7 

13 

22 

44 

13 


(II) 

(II) 

(35) 

(28) 

(15) 

To use performance indicators to determine the ratings 

13 

13 

18 

49 

7 


(15) 

(II) 

(28) 

(31) 

(15) 

To make recommendations to teachers to move their practice forward 

7 

4 

36 

42 

11 


(II) 

(15) 

(35) 

(19) 

(19) 


Source: Stanford Survey of principals, 2011-12, 2010-11. 

Number of valid responses: 45 (2011-12); 54 (2010-11). 

Responses from 2010-11 survey in parenthesis. 

This survey item was not included in the 2009-10 survey. 

► Majorities of principals believed that the new teacher evaluation template improved their abilities to evaluate teachers 
and make decisions based on evaluation ratings. 


During your process for evaluating teachers how much did you do each of the following? <Q20> 



For No For Some For Most 

For All 

111 Z.VJ 1 1 “ 1 z., 


% 

% 

% 

% 

majorities of 

Hold a CSTP standards based evaluation meeting with teacher 

4 

2 

4 

89 

principals held CSTP 
standards based 


(5) 

(5) 

(13) 

(75) 

evaluation meetings 

Had teachers self-assess using CSTPs 

33 

20 

11 

36 

(89%), held CSTP- 


(29) 

(18) 

(13) 

(38) 

based pre¬ 

Held CSTP-based pre-observation conversations 

2 

4 

9 

84 

observation 

(4) 

(4) 

(20) 

(71) 

conversations (84%), 
reviewed written 

Reviewed the written lesson plan with the teacher 

9 

18 

13 

60 

(9) 

(7) 

(13) 

(71) 

lesson plans (60%), 
shared their 

Shared your observation script with the teacher 

16 

13 

7 

64 

observation scripts 


(9) 

(20) 

(15) 

(56) 

(64%), and held 

Held CSTP-based post observations 

2 

9 

27 

62 

CSTP-based post¬ 



(13) 

(22) 

(64) 

observations (62%) 
with all teachers. The 
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Source: Stanford Survey of principals, 2011 -12, 2010-11. 
Number of valid responses: 45 (2011-12); 55 (2010-11). 
Responses from 2010-11 survey in parenthesis. 

This survey item was not included in the 2009-10 survey. 


numbers represent an 
increase from the 
previous year. 








With respect to teacher evaluation, did you do any of the following this year? <Q2i> 


Report I. 



NO 

% 

YES 

% 

Asked your peers for input 

51 

49 


(44) 

(56) 

Shared observation data with your peers 

62 

38 


(65) 

(35) 

Shared thinking on rubric with your peers 

44 

56 


(53) 

(47) 

Helped others in determining ratings using the rubrics and performance indicators 

56 

44 


(72) 

(28) 

Helped others to determine commendations and recommendations on evaluations 

64 

36 


(74) 

(26) 

At Area Meetings, discussed teacher evaluation and best practices 

40 

60 


(37) 

(63) 

Was an outside evaluator or second pair of eyes evaluator this year 

89 

11 


(79) 

(21) 

Met all contractual deadlines for observations and conferences 

27 

73 


(28) 

(72) 

Met most contractual deadlines for observations and conferences 

71 

29 


(74) 

(26) 


Source: Stanford Survey of principals, 2011-12, 2010-11. 

Number of valid responses: 45 (2011-12); 57 (2010-11). 

Responses from 2010-11 survey in parenthesis. 

This survey item was not included in the 2009-10 survey. 

► In 2011-12, most principals shared thinking on rubric with their peers (56%), discussed teacher evaluation and best 
practices at Area meetings (60%), and met all contractual deadlines for observations and conferences (73%). However, 
majorities of them did not ask their peers for input (51%), did not share observation data with peers (62%), did not help 
others in determining ratings using the rubrics and performance indicators (56%), and did not help others to determine 
commendations and recommendations on evaluation (64%). The pattern in the previous school year was similar. 
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To what extent do you agree with the following statements about teacher evaluation? <Q22> 



AGREE 

% 

DISAGREE 

% 

1 am interested in moving to the revised 2009 CSPT 

77 

9 


(83) 

(13) 

1 like the depth of using only 5-8 CSTP elements per observation cycle 

80 

18 


(72) 

(28) 

I’d like to participate in peer feedback on my observation scripts, evaluation ratings & narratives 

73 

23 


(65) 

(35) 

1 want to evaluate all elements each cycle 

25 

66 


(39) 

(57) 

1 need more training at using the rubric and performance indicators 

50 

48 


(54) 

(44) 

1 need more training holding hard conversations 

50 

48 


(56) 

(44) 


Source: Stanford Survey of principals, 2011-12, 2010-11. 
Number of valid responses: 44 (2011-12); 54 (2010-11). 
Responses from 2010-11 survey in parenthesis. 


This survey item was not included in the 2009-10 survey. 

► Majorities of principals were interested in moving to the revised 2009 CSPT, however, they prefer to use only 5- 
8 elements per observation cycle. They were also interested in participating in peer feedback on their observation 
scripts, evaluation ratings and narratives. Also, half of principals indicated that they need more training at using the 
rubric and performance indicators and at holding hard conversations. 
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